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ABSTRACT 

We conduct a photometric and spectroscopic survey of a 10 sq. deg. region surrounding the 
nearby NGC 5846 group of galaxies, using the Canada-France-Hawaii and Keck I telescopes to study 
the population of dwarf galaxies as faint as Mr = —10. Candidates are identified on the basis of 
quantitative surface brightness and qualitative morphological criteria. Spectroscopic follow up and 
a spatial correlation analysis provide the basis for affirming group memberships. Altogether, 324 
candidates are identified and 83 have spectroscopic membership confirmation. We argue on statistical 
grounds that a total 251 ± 10 galaxies in our sample are group members. The observations, together 
with archival Sloan Digital Sky Survey, ROSAT, XMM-Newton, and ASCA data, suggest that the 
giant ellipticals NGC 5846 and NGC 5813 are the dominant components of subgroups separated by 
600 kpc in projection and embedded in a 1.6 Mpc diameter dynamically evolved halo. The galaxy 
population is overwhelmingly early type. The group velocity dispersion is 322 km s , its virial mass 
is 8.4 x 10 13 M Q , and M/Lr = 320M©/Lq. The ratio of dwarfs to giants is large compared with 
other environments in the Local Supercluster studied and, correspondingly, the luminosity function 
is relatively steep, with a faint end Schechter function slope of ay = —1.3 ± 0.1 (statistical) ±0.1 
(systematic) at our completeness limit of Mr = — 12. 

Subject headings: Galaxies: clusters: individual (NGC 5846 Group); galaxies: kinematics and dynam- 
ics; galaxies: halos; galaxies: dwarf; galaxies: luminosity function; X-rays: galaxies 



1. INTRODUCTION 

The mass function of dark matter halos (i.e., their 
abundance as a function of mass) is an important ingredi- 
ent in constraining cosmological parameters using galax- 
ies and clusters of galaxies (Frenk et al. 1990; Kauffmann 
& White 1993; Haiman et al. 2001; Reiprich & Bohringer 
2002; Hoekstra et al. 2002). Very often, an assumed the- 
oretical formula for the mass function is used to fit obser- 
vations so that cosmological quantities such as the mean 
matter density of the universe £l m may be constrained 
(Kochanek et al. 2001; Haiman et al. 2001; Henry 2004). 
However, almost all these methods neglect the fact that 
the abundance of small, 10 9 — 10 10 M Q halos is poorly 
understood. In fact, the very N-body simulations used 
to derive forms for this fitting function, e.g. Sheth & 
Tormen (1999), often produce an abundance of such ha- 
los (sometimes referred to "satellite galaxies") that is 
far in excess of the observations (Moore et al. 1999; 
Kazantzidis et al. 2004; van den Bosch et al. 2005). One 
possibility is that the relationship between the light and 
mass distributions is poorly understood at small masses 
(Gao et al. 2004) — at the scale of dwarf galaxies. It is 
therefore critically important to constrain the luminos- 
ity function of these galaxies (Trentham & Tully 2002; 
Tully et al. 2002; Trentham et al. 2005), thus providing 
a crucial check on the simulations that attempt to model 
galaxy formation. 

It is becoming clear that the relationship between the 



amount of starlight (or gas) that we see and the mass 
of dwarf halos is not simple. There is evidence that 
the amount of light associated with halo mass varies 
strongly with environment (Tully 2005). It may be that 
there are dark matter halos that have retained baryons 
in only undetectably small amounts. Various astrophysi- 
cal processes can lead to a separation of dark matter and 
baryons, e.g., the ram pressure stripping processes such 
those observed in the famous "bullet cluster" IE 0657- 
56 (Markevitch et al. 2002). The relationship between 
the luminosity function and the mass function might be 
complex, but the luminosity function may nevertheless 
retain signatures of specific astrophysical processes or of 
the underlying dark matter spectrum itself. 

The present article is a contribution within a long term 
program to provide a better definition of the faint end 
of the luminosity function of galaxies. The general prop- 
erties of the program are as follows. First, the observa- 
tions should reach very faint absolute magnitudes. This 
goal can only be achieved if the targets are nearby. Sec- 
ond, good statistics are needed in conditions that provide 
control of volume completion. The issue of volume com- 
pletion is addressed by obtaining complete samples to 
an apparent magnitude limit in groups selected to have 
minimal contamination problems. A single group may 
or may not provide adequate statistics by itself. Obser- 
vations of numerous groups may be required. Third, a 
wide variety of environments should be sampled in order 



2 



Mahdavi et al- 



to constrain the possibility of environmental dependen- 
cies. This requirement imposes a need for many nights 
of observations. 

The program depends critically on the recent availabil- 
ity of panoramic digital cameras. The imaging material 
discussed in this paper was acquired with the Canada- 
France-Hawaii Telescope (CFHT) 12K detector (the pre- 
decessor of the current MegaCam). The program also 
depends on some manner of confirmation that galaxy 
candidates are group members, hence relevant to the 
construction of the luminosity function. Confirmation 
is most reliably provided by redshifts, and this paper 
includes the results of spectroscopic observations of rela- 
tively faint, low surface brightness dwarfs with the LRIS 
instrument on the Keck I Telescope.. 

Initial attention was given to well populated clusters 
in both the high density (Trentham 1998b, 1998a) and 
low density (Trentham et al. 2001, hereafter TTV01) 
regimes. These observations suggested that there are 
significant variations with environment (Tully et al. 
2002) — that the luminosity function of dwarf galaxies 
rises steeply in dense environments, but remains flat in 
the field. These results prompted an exploratory sam- 
pling of a wide variety of locations within the Local Su- 
percluster with the Subaru Telescope SuprimeCam im- 
ager (Trentham & Tully 2002, hereafter TT02). It be- 
came clear that much more sky needed to be observed 
to build up meaningful statistics. This paper presents 
results from the first group in the program to receive full 
coverage: a tight, well defined knot of early type galaxies 
surrounding the elliptical galaxies NGC 5846 and NGC 
5813. 

2. OBSERVATIONS 
2.1. NGC 5846: A Well-Isolated Group of Galaxies 

This group is readily apparent because of its high den- 
sity contrast and relatively isolated location. It has been 
studied as a group of galaxies in both the X-ray and the 
optical (Tully 1987; Haynes & Giovanelli 1991; Nolthe- 
nius 1993; Giuricin et al. 2000; Trinchieri & Goudfrooij 
2002; Mulchaey et al. 2003). The distance to the sys- 
tem is taken to be 26.1 Mpc from an average over several 
sources, but most heavily reflective of the Surface Bright- 
ness Fluctuation measurement of Tonry et al. (2001). 
These authors give a distance to NGC 5846 itself of 
25 ± 4 Mpc and a distance to NGC 5813 of 32 ± 3 Mpc, 
estimates we consider compatible with the two being 
at a common distance. The group members are over- 
whelmingly of early type, dominated by the ellipticals 
NGC 5846 (M R = -22.5) and NGC 5813 (M R = -22.2). 
Within this distance, the group is the third most massive 
knot of early type galaxies (after the Virgo and Fornax 
clusters). The virial mass based on velocity information 
to be discussed in a later section, is 8 x 10 13 M Q , and the 
ratio of mass to light at R band is 320M©/Lq. 

The isolation of the NGC 5846 Group is extremely fa- 
vorable. It lies well off the main plane of the Local Super- 
cluster, with no known structure to the foreground and 
very little in the background until the Hercules Super- 
cluster at 10,000 km s _1 . Figure^ 1 is a histogram of all 
Sloan Digital Sky Survey (Abazajian et al. 2004, here- 
after SDSS) and NASA Extragalactic Database (NED 
hereafter) velocities of galaxies within 3° (1.4 Mpc) of 
the center of NGC 5846 (not including our survey be- 
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Fig. 1. — Histogram of velocities of galaxies within 3° of 
NGC 5846. (a) The unfilled histogram shows SDSS and NED 
galaxies; the filled histogram shows the velocities measured 
in our Keck survey, (b) All known velocities within the virial 
radius (0.8 Mpc), shown as the solid histogram; the dashed 
histogram shows only galaxies within 0.5 Mpc of NGC 5846, 
and the dotted histogram shows only galaxies within 0.5 Mpc 
of NGC 5813. 



low). Remarkably, there are no galaxies at all within 
3000 < cz < 6,000 km s" 1 . 

Figure [21 shows the distribution of all but two of the 
galaxies that are established to be within 3° of the group 
on the basis of a measured velocity; the two remaining 
objects are described only as H I detections in the liter- 
ature, without optical counterparts. The shown galaxies 
have velocities in the range 900 < cz < 2700 km s _1 . 

Over the range of environments that will be explored 
in this program, the NGC 5846 Group lies in the regime 
of high density and intermediate mass. It possesses 4 
galaxies brighter than L* (3 E/S0 and an Sb). In this 
paper, 324 galaxies are identified as probable or possible 
members, extending in faintness down to Mr ~ —10. 

2.2. Wide Field Imaging 

Observations of the NGC 5846 Group were made with 
the CFH12K CCD camera in queue mode during 11 
nights between 16 March 2002 and 10 June 2002. An 
overall rectangular area of 220' x 180' was surveyed with 
a small hole to avoid the glare of a 4th magnitude star. 
Two control fields were observed 9° north, in a region 
with no known objects foreground of ~ 10,000 km s _1 . 
The CFHT12K detector is a mosaic of 12 CCD detec- 
tors providing a field of 42' x 28', oriented in this ex- 
periment with the long axis E-W. The observations were 
tiled with half-field overlaps and dithers so that gaps 
between CCD chips were almost entirely covered in sub- 
sequent exposures and most of the area was observed 
twice. In total, 67 x 9 minute exposures were taken, all 
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Fig. 2. — Projected distribution of all galaxies with known 
velocities within 900 < cz < 3000 km s _1 and within 3° 
of NGC 5846. The region of the CFH 12K imaging survey 
is indicated by the dotted rectangle. The circle of radius 
r 2t = 1.85° = 0.84 Mpc centered at 226.40, +1.79 encloses 
the core of the group and shows the region corresponding to 
the second turnaround radius. Galaxies outside the survey 
box are represented by triangles, while galaxies inside the 
survey region have circles with size proportional to the loga- 
rithm of the ii-band luminosity. The stellar symbol locates 
a 4th magnitude star. The NGC numbers identify the major 
bright elliptical galaxies in the group. 



in the Cousins R band, covering 10.05 square degrees. 
Two of the 11 nights were non- photometric but photom- 
etry could be propagated across the entire survey region 
through the half-field overlaps. Seeing was 0.7-1.0 arc- 
sec as mandated by the queue request. Images of the 
individual dwarfs will be available online via the CFHT 
image cutout service (planned for the future). 

Members of the NGC 5846 Group range from spec- 
troscopically accessible high surface brightness objects 
{[in < 20 mag arcsec -2 ) to spectroscopically challeng- 
ing very low surface brightness objects {^r > 20 mag 
arcsec" 2 ). Experience has shown that most low luminos- 
ity galaxies are low surface brightness, although there are 
exceptions (Drinkwater et al. 2003). Candidates can be 
isolated on the basis of this property. Morphological cri- 
teria can then be applied to further evaluate the probabil- 
ity of group membership. The details of the procedures 
to chose candidates have been described in TTV01 and 
TT02. The essence of the process is a culling of the very 
large background population with a concentration index 
threshold. Known dwarfs lie in a distinctly lower concen- 
tration index regime that giant galaxies. Nonetheless, 
substantial numbers of background contaminants man- 
age to pass the concentration index screen and must be 
culled based on morphological criteria. This latter step 
requires inspection of images with the following consid- 



erations in mind. If there is evidence for a bulge or ma- 
jor bar, or spiral structure, or tidal disruption then such 
objects that pass the concentration filter are probably 
background. If instead an object is diffuse except possi- 
bly for a semi-stellar nucleation or patchy structure then 
it is probably nearby, hence a group member. 

In TTV01 and TT02 there is a description of a rating 
scheme developed to characterize the probability of group 
membership for galaxies which have passed the surface 
brightness criterion (1: probable member; 2: possible 
member; 3: conceivable member; 4: almost certainly 
background). Additionally, a rating is given to galax- 
ies that were identified as group members on the basis of 
redshifts before the survey began, whatever their surface 
brightness, and a rating 5 is given to galaxies initially 
rejected as candidates because they lie above the concen- 
tration index cut but subsequently associated with the 
group by a redshift. The availability of velocity informa- 
tion for a significant fraction of the sample now permits a 
reevaluation of the validity of the morphology-based rat- 
ing scheme. In W2. 41 below we show that galaxies rated 1 
and 2 are essentially always found to be group members, 
of order half the galaxies rated 3 are found to be group 
members, but almost none of the galaxies rated 4 are 
group members. Five high surface brightness galaxies 
(identified with a rating 5) are found to be members. 

Before considering the SDSS and out Keck data, 318 
galaxies are identified in the survey region with ratings 
0-3. After including the SDSS, the number increases 
to 324, because 6 priority 4-5 galaxies not originally in- 
cluded in our sample are confirmed by the SDSS as mem- 
bers. These objects are identified in Tabled The magni- 
tudes presented in this table are isophotal i?-band mag- 
nitudes extracted to an isophote of 25.2 mag arcsec -1 . 
Their distribution on the sky is shown in Figure|21 There 
is a strong enhancement in the surface number density 
of both confirmed members and candidates surrounding 
the elliptical NGC 5846 and a secondary enhancement 
surrounding the elliptical NGC 5813. 

The two control fields 9° N were chosen to lie off the fil- 
ament containing the NGC 5846 Group and in the direc- 
tion of the Local Void (Tully & Fisher 1987). No galaxies 
were found in these fields that could be rated 1-3. On 
the basis of the detection rate in the NGC 5846 area, one 
would anticipate 9 such candidates in these fields. 

2.3. Spectrocopic Observations 

The NGC 5846 Group lies within the area with pub- 
lished spectroscopic information from Data Release 3 
of the SDSS. The NASA/IPAC Extragalactic Database 
(NED) and the SDSS provide velocities for 64 of our tar- 
gets, all of them brighter than R ~ 17 or Mr ~ —15. 
There is essentially no prior literature information for 
candidates at fainter magnitudes or for those with very 
low surface brightnesses. In order to probe these regimes, 
we undertook observations using the blue side of the 
Low Resolution Imaging Spectrograph (Oke et al. 1995, 
LRIS hereafter) , on Keck I Telescope. The spectrograph, 
equipped with a 1" slit and a 600 lines in" 1 grating, 
has high blue quantum efficiency, with an overall system 
throughput of 56% at 5000 A. Data were acquired on 
May 4, 2003 and June 13, 2004. Both nights were ham- 
pered by cirrus with extinction of 0.5-2 mag; neverthe- 
less we obtained suitable spectra for 17 and 13 galaxies 
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Fig. 3. — The NGC 5846 Group. The graylevel image shows ROSAT X-ray emission with significance from 3cr (the lightest 
features) to 5a (the darkest features). Spectroscopically confirmed, unconfirmed priority 1, and unconfirmed priority 2 member 
galaxies are marked with circles, squares, and diamonds, respectively. The size of each symbol is proportional to the negative 
of the R magnitude. Unconfirmed priority 3 galaxies are marked with dots of the same size. The contours show the adaptively 
smoothed ii-band light distribution of the members, in units of 0.1, 0.5, 1, 5, and 10 Lq pc -2 . The Gaussian smoothing length 
for each galaxy is the distance to the third-nearest member. 



on the two nights, respectively, of which a total of 19 are 
newly reported members. The poor conditions limited 
attempts to observe the faintest dwarfs; however, good 
spectra were acquired for objects as faint as R — 18.8 
or M R = -13.4. An LRIS spectrum and CFH 12K im- 
age are shown in Figure 0] of the faintest galaxy with a 
redshift. 

2.4. Spectroscopic Membership Confirmation 

The availability of a large number of new velocities pro- 
vides a way of evaluating the membership rating scheme 
based on a concentration parameter and a qualitative 
judgment based on morphology. The NGC 5846 Group 
provides an environment that is particularly well-suited 
to this evaluation, because there is negligible confusion 
from the foreground or near background. Table [3 pro- 
vides a summary of how things have turned out. We 
found all 26 surveyed galaxies with new velocities rated 
1 (probable) and 2 (possible) to be group members. Of 
the galaxies rated 4 (likely background) only one rela- 
tively large galaxy has been revealed by spectroscopy to 
be a member. Among the thousands of galaxies in the 
survey region excluded by the concentration criteria, 304 
have measured redshifts; of these, only 5 galaxies have 
been demonstrated to be group members. 

Thus candidates rated 1 and 2 ought to be group mem- 
bers and, by contrast, very few group members emerge 
among galaxies rated 4 or those excluded because of high 



concentration. That leaves the galaxies rated 3 (conceiv- 
able member) to be considered. We find that velocity 
measurements confirmed 16 galaxies with rating 3 to be 
members and 7 galaxies to be background. 

In summary, the combination of the quantitative con- 
centration parameter and the qualitative morphologi- 
cal evaluation leads to good membership discrimination. 
There remains a grey area with the candidates rated 3. 
High surface brightness objects elude discovery in the 
imaging survey but can be found with a spectroscopic 
survey. Having said all this, the spectroscopic confirma- 
tion is complete only to Mr ~ — 15 and sampled only to 
Mr ~ —13.3. There cannot be complete confidence that 
the rating scheme works among the fainter galaxies that 
extend down to Mr ~ —10.5. It would be surprising, 
though, if there is a population of high surface bright- 
ness galaxies in the group at these faint magnitudes that 
makes a significant numeric contribution to the luminos- 
ity function. 

Henceforth we refer to all member galaxies with red- 
shifts as "spectroscopically confirmed members" ; when 
we refer to priority 0-3 galaxies, we mean only those 
without a redshift. 

2.5. Indicative Membership: Spatial Correlation 

Concentrations of galaxies toward NGC 5846 and 
NGC 5813 are seen in the galaxy projections of Fig. |2 
and in Fig. [21 introduced in the next section. A com- 
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Fig. 4. — (left) Blue LRIS spectrum for the member galaxy N5846-264, the faintest galaxy observed with the Keck I telescope 
(rriR = 18.8, Mr = —13.4). The spectrum quality is typical for the Keck I sample. Visible absorption lines are redshifted Ca II 
lines at 3955 and 3998 A, H/3 at 4893 A, and Mg at 5208 A. Slight US is visible in emission at 4111 A. (right) 1.4' x 1.4' CFHT 
12K image of N5846-264. 



parison of angular 2-point correlations among various 
sub-samples gives hints of different degrees of clustering. 
Sub-samples with relatively weak correlations are proba- 
bly contaminated by non-members. The correlation that 
exists among all 324 galaxies rated 0-3 is shown in the 
upper left panel of Figure [5] The normalization in the 
correlation is achieved by comparison with 1000 Monte 
Carlo random populations of the area of the photometric 
survey. The entire area is overdense with respect to a fair 
sample of the universe so the amplitude of the normal- 
ization is given no meaning. 

Next consider the correlation shown in the same panel 
for 199 galaxies either with membership confirmed by 
redshift or rated 1-2. The spectroscopic evidence sug- 
gests that most of the sample receiving these rating are 
members. Hence the correlation function should be fairly 
representative of the true global function for the group. 
We refer to this function as the "reference correlation" 
hereafter. The reference correlation is more peaked than 
the function describing the ensemble of the candidates. 
The ensemble sample must be contaminated by objects 
drawn from the background. 

Figure 03 shows the correlation for the 83 galaxies es- 
tablished to be group members on the basis of velocities. 
This correlation function is noisier because of smaller 
numbers but is comparable to the function for the 199 
member priority 0-2 sample. The reference correlation is 
actually slightly steeper which tends to confirm that the 
galaxies rated 1 and 2 are overwhelmingly members. A 
different situation is found in the correlation shown for 
the 125 galaxies rated 3. The much flatter distribution 
is evidence that quite a few galaxies rated 3 are non- 
members. The spectroscopic information already dis- 
cussed revealed that only 16 of 23 candidates rated 3 
(70%) are members. 

In the Figure Et, the correlation function is shown for 
the 61 galaxies with the morphological designation dE,N, 



nucleated dwarf ellipticals. Only 12 of these have mem- 
bership confirmed by velocities. Most lie at faint mag- 
nitudes. The correlation analysis suggests that, over- 
whelmingly, galaxies of this morphology are members. 

The spectroscopic information extends to galaxies as 
faint as Mr = —13.4. In total there are 38 priority 3 can- 
didates brighter than this limit. The correlation analysis 
for these galaxies appears in Figure EJi- The correla- 
tion is intermediate between the reference function and 
that shown by the entire rating 3 sample in panel (b). 
We create a simple model in which 30% of the galax- 
ies in the reference correlation are replaced by randomly 
distributed objects. This concoction of 70% correlated 
and 30% uncorrelated components provides a good de- 
scription of the distribution seen in the bright priority 3 
galaxies. This result agrees with the spectroscopic infor- 
mation available for half the objects in question. 

There is no velocity information concerning the fainter 
candidates, and from the poorer correlation seen in Fig- 
ures |S]>|5f it can be inferred that many of the fainter 
rating 3 targets are drawn from the background. In fact, 
the early and late morphological types rated 3 have sig- 
nificantly different correlation characteristics. The dis- 
tinct distributions are revealed in Figure (early types) 
andEF (late types). The 77 galaxies typed dE, dE,N, 
and dE/I show the correlation seen in panel (e) that is 
well described by a mix of objects that are 50% corre- 
lated and 50% uncorrelated (uncertainty ~ 10%). By 
contrast, the late types (mostly dl, a few VLSB) show 
no correlation to the group. To summarize, the correla- 
tion distribution of the rating 3 candidates seen in the 
filled symbols in Fig. can be decomposed into 70% 
group members among those brighter than Mr = —13.4, 
50% group members among fainter early types, and es- 
sentially no group members among fainter late types. 

One final consideration is morphological segregation of 
the galaxies. It is well known that in groups and clusters, 
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Fig. 5. — Two-point correlations, (a) The filled symbols show the normalized 2-point correlation between all 324 candidates for 
membership in the NGC 5846 group. The open symbols give the correlation for the 199 galaxies with either redshift confirmation 
(rating 0) or without known redshift but with membership probability ratings 1 or 2. (b) The open symbols give the correlation 
for the 83 galaxies in the area of the CFHT 12K survey confirmed as members on the basis of redshifts. The filled symbols 
give the correlation for the 125 galaxies with membership probability rating 3. (c) Filled symbols show the correlation for 61 
nucleated dwarf ellipticals, (d) The correlation is shown for the 38 galaxies with membership rating 3 that are brighter than 
Mr = —13.4. The dotted curve illustrates the correlation with a 70% contribution consistent with the reference correlation 
(the solid curve) and a 30% random component, (e) The correlation achieved for 77 galaxies with membership rating 3 that are 
fainter than Mr = —13.4 and early morphological types. The dotted curve presents the correlation with a 50% contribution 
consistent with the reference correlation (solid curve) and a 50% random component, (/) The result of the correlation analysis 
with 27 galaxies with membership rating 3, fainter than Mr = —13.4, and late morphological type. These objects show no 
positive correlation with the group. 
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early-type galaxies are more densely clustered than late- 
type galaxies (Dressier 1980; Postman & Geller 1984; 
Helsdon & Ponman 2003). If the fraction of early- type 
galaxies in the three priority groups differs greatly, the 
morphology-density effect would significantly influence 
the correlation functions. This would lead us to mis- 
interpret differences among the correlation functions as 
differences in the membership probabilities of the galax- 
ies. Fortunately, Table |2 shows that the morphological 
content of the three priority classes is quite similar. The 
weighted average early type fraction in the priority 0-2 
galaxies is 0.82, and for the priority 3 galaxies it is 0.79. 
The difference in the correlation functions is too great 
to be explained just by this small difference in the early- 
type fraction. 

Based on this simple model, we can calculate an esti- 
mate of the total group membership within our survey 
limits: 83 spectroscopically confirmed members; 32 pri- 
ority 1 members; 84 priority 2 members; 60-80% of 14 
bright priority 3 members; and 40-60% of the 84 faint 
early-type priority 3 members. The total estimate is 
251 ± 10 group members. 

3. STRUCTURE OF THE NGC 5846 SYSTEM 
3.1. Broad X-ray and Optical Picture 

Combining the SDSS data with our observations, we 
are able to provide a broad picture of the environment 
of the NGC 5846 system. As evident in Figures ^ an d EH 
the system possesses complex substructure, but remains 
remarkably well isolated from other groups or clusters. 

Another clue to the physical state of the system is 
the distribution of X-ray emission across the group. In 
elliptical-dominated groups, a hot, ~ 1 keV optically thin 
plasma often constitutes the largest baryonic component 
of the group's mass. Archival ROSAT, ASCA, Chandra, 
and XMM-Newton observations of the NGC 5846 region 
exist. The ROSAT All-Sky Survey (RASS) covers the 
entire 10 sq. deg. field of our observations. However, 
with an average exposure time of only 355s, only the X- 
ray emission closest to the two brightest galaxies, NGC 
5846 and NGC 5813, is detected in the survey. We show 
the 0.5-2.0 keV RASS emission in Figure A weak X- 
ray source w 40' to the north of NGC 5846 is visible, but 
it is not associated with any group galaxies, and no op- 
tical sources in either the POSS or the SDSS appear to 
coincide with it. Also shown is the adaptively smoothed 
light distribution of the region. Each member galaxy is 
represented by a Gaussian on the sky with standard de- 
viation equal to the distance to the third nearest member 
galaxy. The Gaussians are then added together. Figure 
makes it clear that the two highest surface brightness 
features in the group, in both the X-ray and the optical, 
are the regions within w 300 kpc of the two brightest 
galaxies. 

The broad picture revealed in both the optical and X- 
ray surface brightness maps is unusual. The NGC 5846 
and 5813 galaxies are two roughly equal peaks of emission 
at both wavelengths, so the system as a whole appears 
binary. However, there are also other ellipticals nearly as 
bright, such as NGC 5838 and NGC 5831, without signif- 
icant X-ray emission but with significant concentrations 
of smaller galaxies surrounding them. We will explore 
the dynamics of the system in greater detail in i)3.3l 



3.2. Two Subgroups: NGC 5846 and NGC 5813 

A central question in understanding the NGC 5846 sys- 
tem regards the existence of "group-scale" X-ray emis- 
sion. Both NGC 5846 and NGC 5813 possess diffuse 
X-ray emission from a hot, optically thin plasma, sug- 
gesting that they mark the center of the two largest dark 
matter concentrations in the system. But is the X-ray 
emitting gas confined to the galaxies only, emitting X- 
rays properly only as the hot interstellar medium of the 
elliptical galaxies (Eskridge et al. 1995), or is there evi- 
dence of a true intracluster medium (ICM) in which the 
galaxies are embedded? An extended ICM would make 
it clear that the NGC 5846 and 5813 galaxies are not 
only bright, X-ray emitting ellipticals; they are also the 
centers of much more massive dark matter halos. Pre- 
vious analyses have considered ROSAT data (Bohringer 
et al. 2000; Ikebe et al. 2002; Osmond & Ponman 2004), 
but no comparisons with high-quality surface brightness 
profiles (such as from the SDSS) or discussions of the 
XMM-Newton observations of NGC 5846 exist. 

To evaluate the extent of the X-ray emission, we exam- 
ine XMM-Newton data for NGC 5846 (superior in sen- 
sitivity and field-of-view to the Chandra data) and the 
ASCA data for NGC 5813 (where neither XMM-Newton 
nor Chandra data is available). We extract X-ray surface 
brightness profiles from the available data. In the case 
of ROSAT and ASCA, we extract pre-calibrated pho- 
ton images and exposure maps from the ROSAT All-Sky 
burvey Data Browser 1 and the NASA HEASARC data 
archive 2 , respectively. For XMM-Newton, only images 
from the highest-sensitivity camera on board the tele- 
scope, the EPIC pn, were available. We use the XMM- 
Newton Software Analysis System (SAS) 3 to reduce these 
data. 

In the case of NGC 5846, the RASS contributes a use- 
ful signal outside the 20' diameter field-of-view of XMM- 
Newton. In the case of NGC 5813, ASCA provides supe- 
rior data to the RASS. For the RASS, we use the 0.5-2.0 
keV data to minimize the noise from the unrelated X-ray 
background. For the XMM-Newton EPIC pn we also use 
photons with 0.5-2.0 keV energies. For the NGC 5813 
observations by the ASCA, we use the full-band images 
covering photon energies 0.7-10 keV. We also extract op- 
tical surface brightness profiles from calibrated g-band 
imaging data publicly available from the SDSS. 

The profiles appear in Figure^] In order that our anal- 
ysis is not affected by the point spread function (PSF) of 
each instrument, we ignore data within a radius 4 times 
the full width of the PSF at half-maximum; the PSF 
deformation of the profiles should be negligible beyond 
these radii (Mohr et al. 1999). We fit the profiles with 
simple azimuthally symmetric models to evaluate their 
extent. While the models may not be correct in detail, 
they are useful tools in characterizing the distribution 
of light in the group. To fit the SDSS g-band optical 
light distribution, we use a modified Sersic (Sersic 1968; 
Trujillo et al. 2004) profile: 

£„(r) = So(r/r e )T exp {-b (r/r e ) a ], (1) 

where r is the projected distance to the galaxy center, 

1 http: //wave . xray.mpe .mpg. de/rosat /data- browser 

2 http : //heasar c . gsf c . nasa . gov/W3Browse/ 
li http://xmm.vilspa.esa.es/sas/ 
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Fig. 6.— (left) From top to bottom, SDSS p-band, XMM-Newton, and RASS X-ray light distributions for NGC 5846, along 
with the best-fit Sersic and /3-models. The bottom two figures show simultaneous fits to the X-ray data, (right) SDSS g-band 
and ASCA X-ray light distribution for NGC 5813. 



r e is the half-light radius, b is a constant, and a and 7 
are the characteristic slopes. The case 7 = 0,a = 1/4 
corresponds to the widely known de Vaucouleurs et al. 
(1976) profile. The Sersic profile (7 = 0, a free) is known 
to fit a subset of the bright elliptical galaxies observed 
with the Hubble Space Telescope (HST). Others, how- 
ever, require a nonzero inner slope 7 for an acceptable 
fit (Trujillo et al. 2004) 4 . 

The X-ray light distribution is characterized by a dou- 
ble /3-model (Mohr et al. 1999): 

E x (r) = S 1 (l + r 2 /r-i)- 3/3l+1/2 

+ £ 2 (l + r 2 /^)- 3&+1/2 . (2) 

The single /3-model was originally used to describe data 
observed by the Einstein observatory (Jones & Forman 
1984). Higher resolution Chandra observations have 
since revealed that emission from relaxed clusters is of- 
ten more complex and requires either a broken power 
law or the two-component /3-model shown above (Buote 
& Lewis 2004). 

The fit results in Table|21suggest substantial differences 
between the two galaxies. The 7 = optical fit for NGC 
5846 is of good quality. The brightest group member 
is consistent with being a de Vaucouleurs et al. (1976) 
model galaxy (a = 1/4). For NGC 5813 the pure 7 = 
Sersic profile is not a good fit. With \ 2 l v — 364/291, the 
fit is rejected at better than 99.7% confidence. However, 
with 7 free, we obtain a good fit. Thus, the dominant 

4 In Trujillo et al. (2004), these so-called "core-Sersic" galaxies 
have inner profiles of the form [1 + (r /r^Y] 1 ^ . However, typical 
values of r^, are 50 — 100 pc, requiring much finer resolution to 
resolve than the data we discuss here possess. Therefore we ap- 
proximate the inner region of the Trujillo et al. (2004) profile as a 
simple power law with slope 7. 



galaxies in the group, though possessing similar Hubble 
types (E0 and El for NGC 5846 and 5813, respectively), 
exhibit different light profiles in detail. NGC 5813's in- 
ner stellar surface brightness profile is consistent with a 
power law of index 1.2, but that of NGC 5846 flattens 
near the center. Such variations in profile shapes are 
also present in field ellipticals observed by HST (Trujillo 
et al. 2004), though the reasons for the existence of two 
populations are not yet clear. 

One clue to understanding the differences in the light 
profiles of the two galaxies may lie in their merging histo- 
ries. Detailed HST observations of the central few arcsec 
in NGC 5813 reveal a dusty circumnuclear disk (Tran 
et al. 2001). The inner region of NGC 5846 contains 
no disk, but X-ray and optical filamentary structures in- 
stead (Goudfrooij & Trinchieri 1998; Tran et al. 2001; 
Trinchieri & Goudfrooij 2002). One interpretation is that 
the filaments in NGC 5846 are relics of interaction with 
smaller galaxies (Goudfrooij & Trinchieri 1998). The fact 
that NGC 5813 contains an undisturbed circumnuclear 
disk suggests that it may have had fewer recent merg- 
ers than NGC 5846. For this reason NGC 5813 retains 
a steeper, more undisturbed stellar profile than does its 
sister galaxy. 

The X-ray data reveal that the intracluster medium 
is more extended than the optical light distribution. We 
obtain acceptable fits for a double /3-model in NGC 5846, 
while for NGC 5813 a single /3-model suffices. The ratio 
of the X-ray to the optical half-light radii for NGC 5846 
and NGC 5813 are 1.3±0.3 and 3.1±0.8, respectively; the 
inferred 90% light radii have ratios of > 2.2 and > 8.2, 
respectively. Interestingly, though NGC 5813 is optically 
less bright NGC 5846, it contains a more luminous and 
extended X-ray halo. 
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Fig. 7. — Radial gradients. Top: surface number density 
dependence on radius for galaxies with observed velocities 
and R < 17.2. The surface number density drops smoothly 
with radius out to ~ 1.8° then drops abruptly to a roughly 
constant value. Bottom: Velocity dispersion as a function of 
radius. Each data point represents the velocity dispersion of 
all galaxies within 0.5 Mpc of a single galaxy; thus, the data 
points are not independent. The sloping line within 1.8° is fit 
to velocity dispersions averaged over the 4 annular bins of the 
top panel. The flat line, showing the mean velocity dispersion 
outside 1.8°, lies at 66 km s _1 . 



3.3. Dynamics 

On dynamical grounds, the NGC 5846 Group can be 
expected to consist of an evolved core surrounded by an 
infall region. Given the mass of the group, the infall re- 
gion is expected to extend to ~ 10° radius, considerably 
beyond the boundaries of the survey region illustrated 
in Fig. The interest of the current study is with the 
dense, dynamically evolved core. The dimensions of that 
core can be inferred from the radial density and velocity 
distribution of galaxies in the vicinity of the group which 
are shown in Figured It is seen in the top panel of that 
plot that the surface number density of galaxies declines 
smoothly with radius out to ~ 1.8° then abruptly drops 
a factor ~ 4 to a roughly constant plateau. In the lower 
panel it is seen that the velocity dispersion within radial 
shells drops by roughly a factor 2 inside 1.8°. Declin- 
ing velocity dispersion profiles are typical of dynamically 
evolved clusters (Mahdavi et al. 1999; Biviano & Kat- 
gert 2004; Sand et al. 2004; Mahdavi & Geller 2004). 
Beyond 1.8°, locally averaged velocity dispersions drop 
to the low levels see in the Local Volume (Karachentsev 
et al. 2003). 

The properties demonstrated in Fig. arc as expected 
from a collapsed group. The ~ 1.8° dimension can 
be inferred to mark the caustic of second turn-around 
(Bertschinger 1985). Objects bound to the group de- 
couple from the cosmic expansion at a radius of first 



turn-around (the zero- velocity surface around the group) 
(Sandage 1986), collapse then reexpand to a second 
turnaround, then continue to oscillate while exchanging 
orbital energy with other group components. An observ- 
able cusp might be anticipated from the recent arrivals 
that have only had time to pass once through the group 
and just reach second turnaround. All other galaxies 
that have collapsed should lie interior (with rare sling- 
shot exceptions). 

If one gives consideration to other dynamically evolved 
groups in the Local Supercluster in a similar maimer, 
one can infer a plausible second turnaround caustic by 
looking for an outer boundary to the distribution of early 
type systems. One of the authors (RBT) has undertaken 
this task, and has determined the following unpublished 
relation between the group velocity dispersion, cry, and 
the radius of the apparent caustic of second turnaround, 
r2t, from observations of 7 dense groups and clusters in 
the Local Supercluster: 

a v /r 2t = 390 km s" 1 Mpc" 1 . (3) 

The conditions in the NGC 5846 Group are consistent 
with this relationship. Because each value of r%t can be 
used to define a value of av(r 2t ) using the velocity dis- 
persion of the galaxies within r 2t , the above expression is 
a nonlinear equation in one variable. Solving the equa- 
tion numerically, we find that 87 galaxies with velocities 
giving a dispersion of cry = 320 km s" 1 , defining a circle 
of projected radius r 2t =0.84 Mpc = 1.84°, are included 
within the projected circle. This value of r 2 t is consistent 
with the radius at which the velocity dispersion profile 
levels off (Figure 0). 

The r 2t circle is superimposed on Fig. [2 with the center 
(at 226. 40, +1.79) chosen to optimize the r 2t enclosure. 
We conduct a virial analysis based on these 87 galax- 
ies, with no luminosity weighting. We apply the median 
virial mass estimator (Heisler et al. 1985), which involves 
no luminosity weighing and does not require the deter- 
mination of a velocity or spatial center. 10000 Monte 
Carlo simulations of the group are used to derive the er- 
rors on the estimated mass. We find the virial mass to 
be 8.3 ±0.3 x 10 13 M Q . 

To further explore the group dynamics, we consider all 
100 galaxies with known redshifts within 3° (1.8 Mpc) 
of NGC 5846, the galaxies plotted in Fig. We con- 
struct a map of the mean velocity and velocity disper- 
sion across the group. We define two functions on the 
sky: v ra (a2000) <^20oo) is the mean velocity of the n closest 
group members to the position (012000 5 <>20oci); o~ n (a,5) is 
the velocity dispersion of the n closest members to that 
position. We show vio(a 2 ooo, ^2000) and crio(c*20oo, <>20oo) 
along with the RASS X-ray contours in Figure |H1 

The maps of i>in and crio are complex in character. 
There is considerable structure in the velocity dispersion 
across the face of the group. The regions associated with 
the bright galaxies NGC 5846, NGC 5813, and NGC 5831 
show large velocity dispersions, « 500 km s _1 , while the 
north-south region at 0:2000 = 15:03:30 (exactly between 
the NGC 5846 and NGC 5813 subgroups) shows a low 
velocity dispersion, rj 300 km s -1 . The spatial clump- 
ing and the velocity dispersion signatures suggest that 
NGC 5846 and NGC 5813 are the centers of distinct sub- 
structures. The persistence of this substructure is inter- 
esting because the characteristic crossing-time between 
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Fig. 8. — Velocity and velocity dispersion maps of the NGC 5846 system. In both maps, contours indicate X-ray emission at 2, 
3, 4, and 5, 6, and 7 a significance. (Left) The grayscale map shows the mean galaxy velocity of the 10 nearest members; black 
corresponds to 1560 km s _1 , and white corresponds to 2130 km s _1 . (Right) The grayscale map shows the velocity dispersion 
of the 10 nearest members; black corresponds to 132 km s~\ and white corresponds to 562 km s _1 . 



these two centers (separation divided by mean group dis- 
persion) is only 1.5 Gyr, ~ 10% the age of the universe. 

The velocity map vio shows a general north-south 
trend in the mean local velocity of the galaxies: the 
galaxies to the north of the NGC 5846-NGC 5813 axis 
have lower velocities than those to the south, perhaps 
indicative of rotation. The complexity of the dynamical 
maps could not have been predicted from the featureless 
velocity histogram (Figure [Ud). A single-peaked, regu- 
lar velocity distribution is not necessarily indicative of 
a relaxed system. The system has almost certainly not 
reached virial equilibrium. 

4. PROPERTIES OF THE MEMBER GALAXIES 

4.1. Surface Brightness Scaling Relations 

The surface brightness properties of the entire sample 
of confirmed group members and plausible candidates is 
demonstrated in Figure The top panel shows the de- 
pendence with luminosity of the mean surface brightness 
within the radius containing half the light of a galaxy, the 
effective radius, while the bottom panel shows the depen- 
dence of the central magnitude through a 300 kpc radius 
metric aperture. In both plots there is a remarkably 
clean separation between high and low surface bright- 
ness systems. A modest separation is also found with 
morphological type in these plots. Types Sa and earlier 
are indicated by circles and lie slightly above types Sab 
and later, labeled with triangles. 

The two plots carry similar information about an over- 
all decrease in surface brightness in proceeding from gi- 
ant galaxies to dwarfs. There is a small difference be- 
tween the plots for systems toward the lower luminosity 
end of the high surface brightness group. If one splits 
the high surface brightness sample at Mr = —20.5, it is 
seen that the fainter portion have higher mean surface 



brightnesses within an effective radius but marginally 
lower metric central magnitudes than the brighter por- 
tion. The increase in mean surface brightness is consis- 
tent with the scaling relation found by Kormendy (1977). 
Trujillo et al. (2001) point out that the ratio of central 
to mean surface brightness varies in a well correlated way 
with the Sersic (1968) parameterization of the radial dis- 
tribution of light. The increase in mean surface bright- 
ness toward fainter luminosities reflects a trend in Sersic 
parameter. As for the apparent decrease in the met- 
ric central luminosity toward fainter though high surface 
brightness galaxies, partly this could be an artifact of 
resolution. The -R300 parameter, the magnitude within 
a radius of 300 pc = 2.4" was chosen to represent the 
central flux without constraining to a radius that would 
be affected by seeing. However, the galaxy N5846-205 
at Mr = —17.5 (labeled 1 in the figure) has an effec- 
tive radius of only 215 pc = 1.6" so the -R300 measure 
under-represents the central flux. With NGC 5846A and 
NGC 5845 (labeled 2 and 3 respectively), effective radii 
are ~ 500 pc. These unusual objects are given attention 
in the following section. 

4.2. Small High Surface Brightness Objects 

The galaxies that are identified by numbers in Fig. [!|] 
are remarkable for their high central densities and small 
dimensions. They are N5846-205 (1), NGC 5846A (2), 
and NGC 5845 (3). They only come to our attention 
through spectroscopic confirmation of an appropriate 
redshift. Their high surface brightnesses would exclude 
them from our sample of group candidates. Hence, our 
selection criteria demonstrably fails in this occasion oc- 
casion. Is this failure common or rare? 

One could ask if there is a relationship with the ul- 
tracompact dwarfs that have been found in the Fornax 
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Fig. 9. — Top: Mean surface brightness within the half-light 
radius as a function of absolute magnitude. Galaxies of early 
type are indicated by circles and galaxies of late type are 
indicated by triangles. Bottom: Central magnitude within 
an aperture of 300 pc (2.4") radius as a function of absolute 
magnitude. The numbers on the plots identify [1] N5846-205, 
[2] NGC 5846A, and [3] NGC 5845. 



Cluster (Phillipps et al. 2001). Those objects are faint 
(Mr ~ — 12) and small (R e ~ 20 pc), so small that they 
are indistinguishable from stars in ground-based imaging. 
They also only came to attention through spectroscopy. 
In the case of the NGC 5846 Group, SDSS spectroscopy 
has provided reasonable completion of non-stellar targets 
in the field that are brighter than R = 17 (Mr = —15). 
Hence, an ultracompact dwarf population like that found 
in Fornax would not be accessed with the current obser- 
vations in the NGC 5846 region, because such dwarfs 
would be both too faint and too small. 

Still, the SDSS spectroscopy does extend to a faintness 
limit that is interesting (Mjj ~ —15) and precludes that 
there is a numerically important population of high sur- 
face brightness objects in the range —15 > Mr > —19. 
Only one high surface brightness galaxy, N5846-205, is 
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Fig. 10. — The core of the group, with all likely members 
(spectroscopically confirmed, priority 1, and priority 2 galax- 
ies). The ultra compact dwarfs are N5846-205, NGC 5846A, 
and NGC 5845. The entire image is a 30' x 30' (230 kpc 
x 230 kpc) section of a POSS plate. Each black box is a 
zoomed-in view of a candidate dwarf galaxy as imaged by the 
CFHT. The magnification within the black boxes is a factor 
of 5 compared to the area outside the boxes. 



found in this range. This system has properties similar to 
the Local Group elliptical M32, though N5846-205, with 
Mr = —17.5, is brighter by a magnitude. The other two 
high surface brightness objects that draw attention in 
Fig. El NGC 5846A and NGC 5845, are small in size but 
have luminosities that put them above the dwarf regime. 

These three high surface brightness systems are very 
close to the core of the group! Their locations are seen 
in Figure These three galaxies are the closest spec- 
troscopically confirmed group members to NGC 5846, 
lying at 5, 25, and 55 kpc in projection (the other galax- 
ies shown in blowup boxes in Figure 1101 are low sur- 
face brightness candidate dwarfs without known veloc- 
ities). This close proximity to the dominant NGC 5846 
of the three most extreme objects in the surface bright- 
ness plot suggests very strongly that these objects have 
been tidally stripped. In this respect, these objects may 
be very large counterparts to the Fornax ultra compact 
dwarfs, suspected also to be the victims of tidal stripping 
or 'threshing' (Bekki et al. 2003). 

These objects are interesting in their own right but 
they are a distraction from the thread of the current 
investigation. The SDSS velocity information assures 
us that high surface brightness galaxies constitute only 
a tiny fraction of the group population in the interval 
— 15 > Mr > —19. There is no information, but no 
reason to suspect, that high surface brightness systems 
make up an important fraction of the population fainter 
than M R = -15. 
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Fig. 11. — NGC 5846 Group luminosity function, (a) Circles represent the density of likely group members. The solid line 
shows the best-fit Schechter function, and the dotted line is the best-fit single power law. (b) Speculative reinterpretation of (a), 
with a Gaussian fit to the high surface brightness galaxies (squares), and a Schechter function fit to the low surface brightness 
galaxies (circles). The dotted lines show the individual fits, and the solid line shows the sum of the two components. The fit 
results are given in Table 2] 



4.3. Luminosity Function 

The analysis in the previous sections has provided 
strong constraints on the group membership down to 
faint levels. The group is sufficiently populated that the 
domain of the region that has undergone collapse is rea- 
sonably defined (rn = 0.84 Mpc). There is confirmation 
of membership for essentially all galaxies brighter than 
Mr = —15 so the luminosity function at the bright end 
is quite secure (though statistics at high luminosities are 
limited). At fainter magnitudes the partial velocity in- 
formation and the spatial correlation information provide 
good constraints on membership probabilities. 

To constrain the luminosity function of the galaxies, 
we place objects in 0.5 mag bins and calculate the sur- 
face number density per unit absolute magnitude. The 
result appears in Figure lTTl If there is only one galaxy in 
a bin, we combine that bin with an adjacent one. The lu- 



minosity function is fit to a faint limit of Mr = —12. We 
assume that the dropoff faintward of that magnitude is 
due to incompleteness. The final luminosity function in- 
cludes galaxies that are likely members according to the 
correlation analysis ( H2.5|) : all galaxies confirmed by ve- 
locities as members, plus all galaxies rated 0-2, plus 70% 
of galaxies rated 3 brighter than Mr = —13.4, plus 50% 
of galaxies of early type rated 3 fainter than Mr = —13.4. 
Because the number of galaxies per bin is small, we use 
the Gehrels (1986) asymptotic formula for calculating the 
error in a bin with N members: 

ejv = l + (0.75 + A^) 1/2 . (4) 

This formula is accurate to 1.5% for all values of N. 

We find a striking feature: there is a plateau, or even 
dip, in the LF at Mr ~ —20. If real and not due 
to noise, this feature cannot be described by a simple 
Schechter (1976) function. A similar feature exists, with 
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Fig. 12. — The surface number density of galaxies in the 
NGC 5846 Group as a function of radius. Filled symbols: all 
galaxies. Open symbols: only galaxies with Mr < — 17. The 
solid line is a fit to the radial distribution of bright galax- 
ies. The dotted lines locate the density at 200 kpc radius 
according to this fit. 



greater significance, in the data described by TT02. The 
Virgo cluster exhibits a quite significant and similar LF 
"bump" (Trentham & Hodgkin 2002). 

We attempt to model this luminosity function using 
progressively more complicated fitting functions. To be- 
gin, in Figure ITTk . we fit a simple power law in luminos- 
ity, 

N(M) = tv_ 19 io-°- 4 («+ 1 )( m + 19 ), (5) 

Where AG 19 is the number density of galaxies with 
Mr = —19, and a is the slope defined so that it matches 
the faint-end slope of a Schechter (1976) function. We 
find this function to be an acceptable fit to the data (see 
Table0J. Given, however, that a single power law mass or 
luminosity distribution is not anticipated by either theo- 
retical models of structure formation or observations, we 
also fit a Schechter (1976) function: 



N(M) =S{M) = AT»exp 



_^q-0.4(M-M») 
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-0.4(a+l)(M-M„) 



(6) 



This function also yields an acceptable fit. However, 
the characteristic magnitude M* is constrained to be 
—24.0 ± 3.2 at 95% confidence. This value is only 
marginally consistent with other analyses of the local 
galaxy luminosity function. For example, the overall 
SDSS luminosity function (Blanton et al. 2001) has 
M* = -20.8 ±0.3 at the 68% confidence level (the differ- 
ence between the R and the r band photometry is negligi- 
ble given our error bars). The value of a = — 1.34±0.06 is 
consistent with the overall SDSS value. FigurelTTk shows 



both the single power law and the Schechter function fits 
to our data. 

Because the single Schechter function fit yields some- 
what too bright an M*, it is useful to evaluate other 
luminosity function models. The surface brightness- 
magnitude diagram (Figure EJ) suggests a third way to 
proceed. There appears to be a significant gap in the sur- 
face brightness distribution in the group population. An 
ensemble of high surface brightness galaxies are clustered 
separately from the rest of the members (chiefly low- 
surface brightness dwarfs). We ask whether the two pop- 
ulations have separate luminosity distributions, similarly 
to what is seen in TT02 and Trentham & Hodgkin (2002). 
To test this idea, we fit these two populations separately 
by dividing them into groups with Mr^qq < 16 and 
-^i?.,300 > 16- In the high surface brightness population, 
one bin between Mr = —19 and Mr = —17 has zero 
members; the error in this empty bin is still described by 
the Gehrels (1986) formulation above (equation EJ. The 
high surface brightness population is fit with a Gaussian, 

I'M M fl N - 

V °9 



N(M) = N g exp 



(7) 



while the low-surface brightness population is fit with a 
Schechter function. The results appear in Figurc lTTb and 
Table H 

The Gaussian and Schechter functions provide a good 
fit to the LF of the two respective populations. The 
faint-end slope a = —1.23 ± 0.12 is consistent with the 
faint-end slope of the single Schechter function fit; the 
difference derives from the fact that the high-luminosity 
galaxies are excluded, leading to a much fainter M* = 
— 18.5 ± 1.3. The well-known correlation between Af* 
and a then leads to a smaller best- fit value of a. 

Our method for the inclusion of the priority 3 members 
may lead to systematic errors in a. To constrain these 
uncertainties, we undertake two further fits. First, we 
measure a for only the spectroscopically confirmed plus 
the priority 1-2 members, obtaining a = — 1.17 ± 0.15. 
Then we measure a for all the spectroscopically con- 
firmed members plus the priority 1-3 members, obtaining 
a = —1.38 ± 0.10. Thus, we expect both the statistical 
and systematic errors in a to equal be ps 0.1. Our final 
adopted a is an attempt to encapsulate all the complex- 
ities of the sample into a single value. We take the mean 
between the whole-sample and the low surface brightness 
fits: a = —1.3 ±0.1 (statistical) ±0.1 (systematic). 

Given the large number of free parameters and the 
small number of data points, the need for a Gaussian 
high-luminosity component is not statistically signifi- 
cant. However, a formulation more complicated than 
the Schechter function is required to describe any saddle 
between the giants and the dwarfs, a saddle that it seen 
recurrently in different samples, e.g. TT02 and Tren- 
tham & Hodgkin (2002). The present formulation may 
have some physical sense if the separation between high 
and low surface brightness systems seen in the scaling 
relations has some meaning. We have discussed surface 
brightness bimodality and a possible dynamical interpre- 
tation in the context of a sample dominated by late- 
type disk galaxies (Tully & Verheijen 1997). It is not 
clear if that discussion has relevance to this sample of 
predominantly early types. We do not argue that the 
present sample in itself provides justification for adopt- 
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Fig. 13. — Schematic comparison of the NGC 5846 Group 
luminosity function with other samples. A solid curve rep- 
resents the best-fit power law to the NGC 5846 Group. The 
dashed curve shows the speculative Gaussian plus Schechter 
fit . The curves labeled 'subaru 6 groups' and 'UMa' are taken 
from TT02. The 6 groups curve represents an average found 
for the dwarf regime in 6 groups discussed by TT02. The 
density normalizations are carried out in a consistent way in 
these separate cases. The steeper line labeled 'mass function' 
indicated the low mass slope of a modified Press-Schechter 
distribution with arbitrary vertical scaling. 



ing a two-component luminosity function. The matter 
is something to review as material accumulates for more 
environments. 

Finally, we wish to compare the luminosity function 
for this group with those found in other environments. 
To make this comparison we need a number density nor- 
malization. As a matter of convenience and to establish 
a convention, we determine a density in luminous galax- 
ies (Mr < —17) at a radius of 200 kpc from the group 
center. We are looking for variations in the bright/faint 
distributions which is why the group density definition is 
restricted to just the bright members. The metric ra- 
dius of 200 kpc is chosen because it is representative 
of the core of our smallest groups. Details of the nor- 
malization procedure are discussed by TT02. Figure 112*1 
presents the run of the density of galaxies with radius in 
the NGC 5846 Group in a fashion analogous to what is 
found in TT02. The fit to the density distribution of the 
luminous galaxies (open symbols) gives a normalization 
of 29 galaxies/Mpc 2 at a group radius of 200 kpc. The 
resulting renormalized LF, and a comparison with other 
groups, appears in Figure 

5. SUMMARY 

The long-term goal of this project is to explore the na- 
ture of the luminosity function of galaxies over a wide 
range of environments. In previous studies of environ- 



Fig. 14. — Percentage of dwarf galaxies (— 17 < Mr < — 11) 
classified as dE (including nucleated dE,N subtypes and tran- 
sition dE/I subtypes). Data for groups other than NGC 5846 
are from TT02. The x-axis shows the ranking of the groups 
in order of decreasing central galaxy density. 



ments in the Local Supercluster we have not had the 
areal coverage to encompass substantial fractions of the 
target groups. This deficiency is corrected in the present 
study of the NGC 5846 Group. It is seen in Fig. [3 that 
the area of our CFHT wide field survey covers almost 
the entire region subsequently considered to lie within 
the second turnaround cusp, r 2 t- Dwarf galaxies as faint 
as Mr ~ — 10 can be identified in the group, with incom- 
pletion setting in at Mr ~ — 12. 

Almost all galaxies associated with the group with 
Mr < — 15 are spectroscopically confirmed. We iden- 
tify 324 probable or plausible candidates of which 83 
have redshifts. Based on redshift sampling and a cor- 
relation analysis, we suggest that 251 ± 10 of the 324 
candidates are true members. The number of dwarfs in 
the NGC 5846 Group is very large. If, following TT02, 
a dwarf-to-giant ratio is defined as No. galaxies with 
-11 > Mr > -17 over No. galaxies with Mr < -17 
then dwarfs / giants — 7.3 ± 0.7. The error includes the 
uncertainty in the rating 3 memberships and incomplc- 
tion near the Mr = — 11 limit. This ratio of dwarfs to 
giants is larger than the values seen in any of the TT02 
groups. Figure fl4l compares the percentage of dwarf el- 
liptical galaxies (-11 > M R > -17) in the NGC 5846 
Group with the TT02 groups. The NGC 5846 Group 
is overwhelmingly populated by early type dwarfs, with 
80% ±5%, comparable to the situation in the Virgo Clus- 
ter. About 1/3 of the early-type dwarfs are nucleated. 

The large dwarf to giant ratio is reflected in the rela- 
tively steep luminosity function at faint magnitudes. The 
simplified single power law slope of ay — —1.34 ± 0.08 
is significantly steeper than the mean slope for 6 groups 



NGC 5846 Group 



of a d = -1.19 ± 0.06 found by TT02 (95% probability). 
We also show the luminosity function found for the low 
density, spiral rich Ursa Major Cluster where the faint 
end slope is ay ~ —1.0. All of these observed luminosity 
functions are much shallower than the modified Press- 
Schechter mass function expected from the AC DM hier- 
archical clustering paradigm (Sheth & Tormen 1999). 

The present observations taken with the earlier work 
already strongly support the proposition that the faint 
end of the luminosity function of galaxies varies with 
environment. Alternatively expressed, the ratio of 
dwarf to giant galaxies varies with environment. The 
dense, dynamically evolved NGC 5846 Group has a high 
dwarf/giant ratio and a relatively steep faint end lumi- 
nosity function. Still, even in this environment there is 
a dearth of dwarfs compared to the expectations of the 
AC DM mass spectrum. There is the implication that 
astrophysical processes have affected the visible manifes- 
tations of low mass halos, and in ways that are more 
effective at suppression of light in lower density environ- 
ments. 

We thank the anonymous referee for insightful com- 
ments. This program involves observations with the 
Canada-France-Hawaii and Keck telescopes. It is sup- 
ported by NSF award AST-03-07706. 
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TABLE 1 

Photometric and Spectroscopic Data 



Galaxy ID P 


O2000 




Type m Rt 25.2 m.R,300 Mr 


Ar r e 


flR 


cz 


Notes 


N5846- 















001 


3 


14:57:32.5 


+00:49:40 


dE,N 


21.08 


22.54 


-11.13 


0.12 


3.3 


25.65 


002 


3 


14:57:40.3 


+02:46:40 


dE 


20.77 


21.74 


-11.45 


0.13 


2.6 


24.85 


003 


3 


14:57:43.3 


+01:21:18 


dl 


18.83 


20.67 


-13.37 


0.12 


4.9 


24.27 


004 


2 


14:57:45.1 


+03:25:56 


dE 


20.37 


21.83 


-11.85 


0.14 


3.7 


25.22 


005 


3 


14:57:48.5 


+02:11:47 


dE 


21.16 


21.92 


-11.06 


0.14 


1.9 


24.60 


006 


3 


14:57:52.2 


+03:03:56 


dl 


18.82 


20.22 


-13.38 


0.12 


3.5 


23.50 


007 


3 


14:57:52.3 


+02:26:39 


dE 


21.52 


22.73 


-10.70 


0.14 


2.6 


25.57 


008 


3 


14:57:53.0 


+01:04:48 


dE 


20.14 


21.11 


-12.07 


0.12 


2.8 


24.37 


009 





14:57:53.1 


+00:56:03 


E/S0 


15.35 


17.90 


-16.86 


0.12 


8.9 


22.09 


010 


3 


14:58:07.0 


+02:03:43 


dE 


18.70 


20.23 


-13.51 


0.13 


4.0 


23.68 


011 


1 


14:58:12.6 


+01:59:39 


dE,N 


19.81 


21.27 


-12.39 


0.12 


3.6 


24.62 



1886 



Note. — The full version of the table will appear in the Astronomical Journal. The morphological type is 
indicated as follows: dl, dwarf irregular; dE, dwarf elliptical; N, nucleated dwarf; E, elliptical; S, spiral; and 
VLSB, very low surface brightness galaxy. P is the original membership probability assigned to the galaxy 
purely from photometry and morphology (0 = non-SDSS spectroscopic redshift; 1 = probable member; 2 
= possible member; 3 = conceivable member; 4 = likely not a member), rona.j, tur^oo and Mr are the 
measured R band magnitudes, with the first being the isophotal magnitude (to 25.2 mag arcsec -1 ), the 
second being the magnitude within 300 pc (2.3"), and the third being the isophotal absolute magnitude. 
Ar is the reddening, and r e is the half-light radius in arcseconds. The heliocentric velocity in km s -1 is 
cz. The notes give other galaxy identifications; ZM indicates data from (Zabludoff & Mulchacv 1998). All 
redshifts are from the NASA Extragalactic Database, unless the date of a Keck observation is indicated, 
in which case they are new. Galaxies marked with "sat" were saturated in our imaging; for these galaxies, 
all values were derived from SDSS public data, with appropriate conversions from the SDSS r to Cousins 
R photometric bands. 



TABLE 2 
Membership Determination 



Priority 


Early- Type 


Number of 


Confirmed Members 


Confirmed Members 


Confirmed 


Rating 


Fraction 


Candidates 


In the Literature 


With Keck I 


Non-members 





0.60 


35 


35 








1 


0.79 


39 


3 


1 





2 


0.90 


102 


6 


13 





3 


0.73 


149 


15 


2 


7 


4,5 






6 
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TABLE 3 

NGC 5846 and 5813: X-ray and Optical Fits 

Parameter NGC 5846 NGC 5813 

Optical Fit using r '> e - b< - r / r ^ a 
X 2 /f 216/234 285/293 

7 =0 -1.23 ±0.01 

a 0.253 ±0.003 1.01 ±0.06 

50% light radius (r e ) 8.8 ± 0.7 kpc 10.7 ± 0.6 kpc 
90% light radius a 48 ± 5 kpc 22 ± 1 kpc 

X-ray Fit using (3 Models 

X 2 /v 120/119 8/17 

ri 1.7 ±0.1 kpc 20 ±3 kpc 

fix 2.2 ±0.6 0.67 ±0.03 

r 2 28 ± 4 kpc 

f3 2 0.55 ±0.01 

S 2 /Si 9.5 ±0.8 

50% X-ray radius a 11.8 ±2.3 kpc 33 ± 8 kpc 

90% X-ray radius a > 110 kpc 180 ± 80 kpc 



Note. — Best-fit values and 68% confidence in- 
tervals are shown. 

a These parameters depend entirely on the other 
fit parameters; the quoted intervals are derived 
from the best fit parameters and errors using Monte 
Carlo simulations. 



TABLE 4 
Luminosity Function Fits 



Data Set 


Fit Type 


Parameter 


Best Fit 


All Data 


Power Law 
X 2 /v = 8.2/15 


a 

iV_l 9 


-1.34 ±0.08 
3.0 ± 1.2 


All Data 


Schechter 
x 2 /y = 8.2/15 


a 

M, 
N, 


-1.34 ±0.08 
-24.0 ±3.1 
0-49_ 23 


Low-SB 
Galaxies 


Schechter 
x 2 /v = 4.4/11 


a 

M* 


-1.22 ± 0.12 
-18.5 ± 1.3 
6.0 ±3.1 


High-SB 
Galaxies 


Gaussian 
X 2 lv = 1.1/4 


M G 
N G 


-21.2 ± 1.6 



Note. — The 95% confidence intervals take the 
correlation among all the parameters into account; 
they are reported as one-sided when the lower and 
upper errors are similar, and as two-sided when the 
lower and upper errors differ substantially. The nor- 
malizations N„ and iV_ig are in units of Galaxies 
Mpc -2 mag -1 . 



